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NONLINEARITIES  WITH  NON-GAUSSIAN  INPUTS 
Cary  L.  Wise 

Department  of  Electrical  Engineering 
University  of  Texas  at  Austin 
Austin,  Texas  78712 


Abstract 

This  |>aper  Is  concerned  with  the  band- 
llmltedness  of  the  output  of  a nonlinearity 
with  a random  Input.  The  Input  Is  taken  to  be 
a contaminated  Gaussian  process.  It  Is  shown 
that,  if  the  nonlinearity  Is  not  a polynomial, 
or  If  the  Gaussian  Input  component  Is  not  band- 
limited,  then  the  output  is  not  bandllmlted. 

I.  Introduction 


llm 

s-*t 


E{[N(s)-N(t)]  } - 0 
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This  Is  equivalent  to  the  autocorrelation  func- 
tion R being  continuous  at  the  origin. 

If  N(t)  Is  mean  square  continuous,  the 
spectral  representation  of  N(t)  Is  of  the  form 


N{t)  • / dSi(u) 


In  statistical  communication  theory,  as 
well  as  other  areas  of  engineering,  we  are 
frequently  Interested  In  nonllnearltles  with 
random  Inputs.  Also,  In  the  context  of  signal 
transmission,  the  bandwidth  occupied  by  a ran- 
dom signal  or  noise  Is  of  concern.  The  effect 
of  a linear  system  upon  the  bandwidth  proper- 
ties of  a random  process  Is  well  understood; 
however,  such  Is  not  the  case  for  nonlinear 
systems.  In  this  paper  we  will  consider  the 
effect  of  a nonlinearity  upon  the  bandwidth  of 
a class  of  random  processes. 

By  the  term  nonlinearity  we  will  refer  to 
a time  Invariant  zero  memory  nonlinearity. 

That  Is,  the  output  at  time  t Is  a function 
only  of  the  Input  at  time  t.  Such  nonlinearl- 
tles  are  frequently  encountered  In  the  form  of 
quantizers,  companders,  limiters,  power  law 
devices,  etc. 

In  the  next  section  we  will  precisely 
state  our  assumptions,  and  we  will  review  some 
established  results.  Then  in  the  succeeding 
section  we  will  develop  the  principal  result 
of  the  paper. 

II.  Preliminaries 

The  parameter  set  of  the  random  processes 
will  be  the  real  line,  and  the  parameter  will 
be  associated  with  time.  Let  N(t)  be  a second 
order  random  process,  and  aasusw  that  N(t)  Is 
second  order  stationary;  that  la 

P{H(t^)  < n^  , NCtj)  1 nj)  - 

P{N(tj+tQ)  < Uj  , NCtj+tg)  < Uj} 

for  all  tg,  tj^,  t2>  and  n2.  Thus  the  auto- 
correlation function  E{N(t)  N(s)}  Is  a function 
only  of  the  time  difference,  R(t-s).  The  ran- 
dom process  Is  mean  square  continuous  if,  for 
all  t. 


where  the  Integral  Is  defined  as  a limit  in  the 

mean  and  Sl(u)  Is  a random  process  with  ortho- 
gonal Increments.  It  follows  that  for  U2  ^ 

E{[N(u.2)  - ■ ’'<“1’ 

and 

R(t)  - /”  e^"''  dF(i..)  . 


The  function  F Is  called  Che  spectral  distribu- 
tion function.  The  spectrum  of  the  random  pro- 
cess N(t)  consists  of  all  the  numbers  in  whose 
neighborhood  F Is  actually  Increasing;  that  is, 
the  spectrum  Is  the  set  of  all  numbers  Ug  such 
that 

F(<l>g+t)  - F(Ug-c)  > 0 

for  all  e > 0.  These  numbers  are  the  frtiquen- 
cies  that  enter  effectively  in  the  harannlc 
analysis  of  both  the  autocorrelation  function 
and  Che  sample  functions  of  the  random  process. 
The  above  properties  are  well  known  and  can  be 
found  developed  in  [1,  chapter  10}  and 
(2,  chapter  11]. 

Let  X(t)  be  a second  order  stationary 
Gaussian  random  process  with  a positive  variance. 
Assume  that  X(t)  and  N(C)  are  Independent  random 
processes  that  are  mean  square  continuous.  Let 

Y(t)  - X(t)  + N(t)  . (1) 

Then  Y(t)  Is  a contaminated  Gaussian  process. 

Consider  the  class  of  all  Balre  functions 

g(-)  such  that  E((g(Y(t)])^)  < ■».  All  non- 
llnearltles will  be  assumed  to  belong  to  this 
class.  The  nonllnearltles  gj^(')  and  g2(‘)  will 

be  regarded  as  Identical  If  gj^[Y(t)]  and  g2(Y(t)] 


PeM»nt»d  at  tha  1978  Canferenoe  on  Infomation  Soianoaa  and  Syetam,  Maroh  29-31,  1978; 
to  b«  ptSHthad  in  tha  Pivoaadingt  of  the  Conferenoe. 


rmsBfmsrwv 


lUgnuil  tor  pvbBs 

OMfbodflB  UalmHsd 


OFFIC*  of  scientific  research  fAXwn 

notice  of  TRAfTSMITTAL  TO  DDC 

opprovcd^firjii-’^i  ^•‘'viewod  and  la 

Af  0.  BLOSS 

Taoteloal  Infonaatlon  Offloar 


are  equivalent  randon  procesaes.  Throughout 
the  aequel  it  will  be  aaauaed  that  g(’)  la  not 
a conatant. 

The  randoa  proceaa  y(t)  will  be  taken  aa 
the  Input  to  the  nonlinearity  and  the  output 
g(y(t)]  will  then  be  a well  defined  aecond 
order  randoa  proceaa  that  la  aecond  order  ata- 
tlonary.  We  will  be  concerned  with  the  apectral 
properties  of  the  output,  and  thus  we  should 
insure  that  the  output  possesses  a spectral 
representation.  This  property  Is  established 
by  the  following  two  theorems. 


Theoreg  1;  A second  order  randoa  process  that 
Is  second  order  stationary  possesses  a spectral 
representation  if  and  only  If  It  Is  aean 
square  continuous. 


This  theorem  is  proved  In  (1,  pp.  A82- 


Theorem  2:  Let  S(t)  be  a aecond  order  random 
process  that  Is  first  order  stationary  and  mean 
square  continuous.  Let  g(-)  be  any  Baire  func- 
tion such  that  E{ (g[S(t)] )^)  < Then 
g[S(t)]  Is  mean  square  continuous. 


For  example,  let  C(c)  be  a bandlimited  Gaussian 
process  possessing  a spectral  density  function. 
Then  let  arc  tan  (G(t)]  be  the  Input.  By 
Theorem  3 this  Input  Is  not  bandlimited;  and  If 
g(‘)  Is  a polynomial,  the  output  also  will  not 
be  bandlimited.  However,  If  g(x)  • tan  x,  then 
the  output  will  be  bandlimited,  even  though  the 
nonlinearity  Is  not  a polynomial. 


In  this  section  we  will  establish  necessary 
conditions  for  Che  output  to  be  bandlimited  when 
Che  Input  Is  Che  contsadnated  Gaussian  process 
y(t)  given  by  (1) . 

For  the  moment,  consider  CtK>  zero  mean 
mutually  Gaussian  randoa  variables  X and  Y, 
with  correlation  coefficient  p,  and  each  with 
2 

variance  o >0.  If  |p|  < 1,  then  a bivariate 
density  function  f(x,y)  exists.  Using  Che 
Mehler  formula,  we  can  write 


2iio^/-p^ 


>r — 2"-^^ — 2~  (x^-2pxy+y^)l 
L2o^1-p^)  J 


This  theorem  is  proved  in  (3]. 


p(x)  p(y)  I p"  9.(x)  9 (y) 
n-0  " " 


A randoa  process  Is  said  to  be  bandlimited 
If  it  has  a bounded  spectrum;  that  Is,  If  there 
exists  a finite  number  M such  chat  the  absolute 
value  of  any  point  In  the  spectrum  Is  less  chan 
M.  If  the  Gaussian  process  X(t)  possesses  a 
spectral  density  function  (l.e.  the  spectral 
distribution  function  Is  absolutely  continuous), 
the  following  theorem  completely  characterizes 
Che  bandllml redness  of  the  output  when  the 
Input  Is  X(t).  The  nonlinearity  In  the  fol- 
lowing theorem  Is  assumed  to  belong  to  the 
class  described  earlier  when  N(t)  Is  Iden- 
tically zero. 


Theorem  3:  Assume  that  the  Gaussian  process 
X(t)  possesses  a spectral  density  function. 
Then  g[X(t)l Is  bandlimited  If  and  only  If 


A.  X(t)  Is  bandlimited. 


P(x)  - exp  [-  -Sj  \ 

/2ir  0 \ 2o^  / 


H ( - ) 
n * o 


H^(‘)  Is  the  n-th  Hermlte  polynomial  given  by 
H^(x)  - (-1)"  exp  ^ exp  (■  x)  ' 


and  Che  series  Is  convergent  polnCwlse  as  well 
as  In  an  Lj  sense  [5].  Let  g^(‘)  and  g2(') 

be  any  Baire  functions  such  that 

BdgiWJ^)  < - . 1 - 1.2- 


B.  g(‘)  Is  a polynomial. 


This  theorem  Is  proved  In  [4]. 

Notice  that  Theorem  3 does  not  hold  In 
general  If  we  drop  the  Gaussian  assumption. 


Then  g^C')  admits  the  expansion 

gl(*)  ■ I 9^(x) 

n"0 
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oa 


*>n  ~ f e^(x)  p(x)  dx 


and  the  convergence  Is  in  the  sense  that 


11“  / TsiCx)  -lb  e„(x)l^  p(x)  dx  - 0. 

K-h.  L ^ n-0  " " J 


Slnllarly, 

OB 

*2^*^  ■ -L  «n<»> 


process  N(t),  and  therefore,  without  loss  of 
generality,  assuae  that  X(t)  has  zero  aean. 

2 

I«t  o,  denote  the  variance  of  X(t),  and  let 
p(t-s)  denote  the  correlation  coefficient  of 
X(t)  and  X(s).  Using  the  results  outlined 
above,  we  have  that  the  conditional  expectation 
Is  almost  surely  given  by 

E{gnf(t)]  g(Y(s)]|H(t),K(s))  - 


I [p(t-e)]"  b„[N(t)]  b„[N(s)] 
n-0  " " 


g2(»)  9„(x)  p(x)  dx 


'’n^y^  " gCx+y)  p(x)  dx. 


and  the  convergence  Is  in  the  same  sense.  It 
then  follows  in  a straightforward  fashion  that 


E{gi(X)  g^CY)}  - I b^c^p". 
n"0 

Now  assume  that  p-1.  Using  the  Schwarz 
Inequality,  It  follows  that  X-Y  with  probability 
one.  Then  we  get  that 

E{gi(X)  gjCY)}  - E{g^(X)  gjCX)) 


y b c 
n n 

n-0 


Now  assume  that  p--l.  It  then  follows  from  the 
Schwarz  Inequality  that  X— Y %rlth  probability 
one.  Then  E{g^(X)  g^CY))  - E{gj(X)  g^C-X)}. 

However,  since  6„(x)  Is  even  for  even  n and 
odd  for  odd  n,  we  get  that 


r g2(-x)0„(x)p(x)dx-(-l)"  /"  g2(x)e^(x)p(x)dx. 


Using  this,  we  then  get  that 


E{gl(X)  gjCY)}  - I (-1)"  b c . 

n-0  " “ 


Now  we  return  to  the  problem  at  hand.  He 
will  first  calculate  the  autocorrelation  func- 
tion of  the  output  of  the  nonlinearity.  Thus 
we  are  Interested  in  the  quantity 

E(gIY(t))  g(Y(s)])  - 

E(g[X(t)-HI(t)]  g(X(s)-HI(s)l). 


Thus  we  see  that  the  output  autocorrelation 
function  Is  given  by 


E{g[Y{t)]  g[Y(s)l 


E y (p(t-s)]"  b [N(t)]b  [N(s)] 
(n-0  ) 

Notice  that 

|[p(t-8)]"  b^[H(t)]  b^[N(s)]|  < 


(b„(H(t)])^  + (b^[H(s)])^ 


jj(bn(N(t)])2+  (bn(N(s)j)2]!. 


2 E{(g(Y(t)])‘}  < -. 

Thus  the  Dominated  Convergence  Theorem  Justi- 
fies exchanging  the  expectation  and  the  Infi- 
nite summation.  Therefore,  we  have  that 

E{g|Y(t)l  gtY(8)]}  - 


I (p(t-8)]"  E{b„[N(t)]b„[N(8)]). 
n-0  ” " 


Notice  that  b^^C')  can  be  interpreted  as  a 
nonlinearity,  and  thus  b^[N(t)]  Is  a second 

order  random  process  that  Is  second  order 
stationary.  Thus,  E{b^[N(t)]  b^[N(s)]}  Is  a 

nonnegative  definite  function  of  (t-s),  say 
R^(t-s),  and  we  see  from  Theorem  2 that  E^(*) 

is  continuous.  Therefore, 


Associate  the  mean  of  X(t)  with  the  random 
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E{glY(t)l  glY(.)])  - I Ip(t-«)l"  R (t-8), 
n«0 

Letting  r(*)  denote  the  autocorrelation  func- 
tion of  the  output,  we  get  that 


r(T)  - I (p(t)1“  R„(t)  . (2) 

n-0  " 

Since 

r(0)  - I R„(0)  < 
n-0 

we  aee  that  the  convergence  in  (2)  is  unlfora. 

Let  G(u)  be  the  spectral  diatrlbution 
function  corresponding  to  r(T).  That  is, 

r(T)  - /**  dG(u). 


If  we  require  G(-»)  - 0 and  G(0  to  be  right 
continuous,  then  G(")  is  uniquely  detenlned 
by  r(')  [2,  pp.  S19-S22].  In  the  sequel  all 
spectral  distribution  functions  will  be  assumed 
to  be  right  continuous  and  to  vanish  at  minus 
infinity.  Therefore,  we  can  also  uniquely 
determine  the  spectral  distribution  functions 
corresponding  to  p(*)  and  R„(-),  that  is, 

p(t)  - e^“^  d D{u) 


R„(t)  - r <>  DjjCu). 

Recall  that  the  spectral  distribution  function 
of  the  product  of  autocorrelation  functions 
is  given  by  the  convolution  of  the  spectral 
distribution  functions  corresponding  to  each 
of  the  autocorrelation  functions.  This  can 
be  easily  seen  if  one  forms  the  analogy  between 
autocorrelation  functlona  and  characteristic 
functions  and  between  spectral  distribution 
functions  and  probability  distribution  func- 
tions. 

Due  to  uniform  convergence,  we  can  trans- 
form (2)  term  by  term  to  get 

G(u)  - Dj,(u)  + D(u)  * Dj^(o)) 

. (3) 

+ Z ([D(«)]*")  * D„(«)  , 

n-2  " 

where  * denotes  convolution,  that  is. 


F^(u)  a p^(„)  . p r^(u.-X)  dF2(X)  , 

and  [*]  ° denotes  multifold  convolution. 

Recall  that  to  any  spectral  distribution 
function  there  corresponds  a symmetric  non- 
negative  definite  function  [2,  pp.  519-522], 
and  to  any  such  syaetrlc  nonnegative  definite 
function  there  corresponds  a stationary  second 
order  random  process  [2,  p.  72].  Thus,  for  any 
spectral  distribution  function  F,  define  B(F) 
as  the  supremum  of  the  spectrum  of  the  asso- 
ciated random  process.  Notice  that  -B(F)  is 
then  the  Inflsnim  of  the  spectrum  of  the  asso- 
ciated random  process.  Thus  a random  process 
having  a spectral  distribution  function  F is 
bandlimlted  if  and  only  if  B(F)  < <».  For  two 
spectral  distribution  functions  F^  and 

follows  in  a straightforward  fashion  that 
B(F^*F2)  ■ ®<^1^  * ®<^2^- 

Notice  that  if  R„(0)  - 0,  then  b [N(t)]  - 0 
“ n 

with  probability  one.  If  all  but  a finite 
number  of  the  R^(0)  were  tero,  then  all  but  a 

finite  number  of  the  b^(N(t)]  would  be  zero  with 

probability  one;  and  in  this  case  g{x4N(t)] 

%K>uld  be  a polynomial  in  x (with  random  coef- 
ficients). Therefore,  if  g(‘)  is  not  a poly- 
nomial, then  an  infinite  number  of  the  R„(0) 

are  nonzero.  Notice  that  if  R„(0)  is  nonzero, 
then  D^(u)  is  not  Identically  zero. 

Assume  that  g(*)  is  not  a polynomial. 

Notice  that  for  K ^ 2, 


Bj^  (lD(u)]*")  * D^(u)J  < B(GM], 

and  as  K approaches  infinity,  the  left  hand 
side  of  the  above  Inequality  Increases  to 
infinity.  This  result  is  sunarlzed  in  the 
following  theorem. 


Theorem  4:  Let  the  random  process  Y(t)  be 
given  by  (1)  and  assume  that  g(‘)  is  not  a 
polynomial.  Then  g[Y(t)]  is  not  bandlimlted. 


Slnca  we  are  assuming  that  the  nonlinearity 
is  not  constant,  then  for  at  least  one  value  of 
n i 1,  R^(0)  > 0,  and  thus  D^^Cu)  is  not  iden- 
tically zero.  Thus  we  see  from  (3)  that  if  the 
Gaussian  component  X(t)  is  not  bandlimlted, 
then  the  output  will  also  not  be  bandlimlted. 
This  observation  la  suHsrized  in  the  follo%ring 
theorem. 


J 


Thmortm  i:  Let  tb*  raadoa  proceaa  y(t)  ba 
glvto  bp  (1)  and  aaauaa  chat  tha  Cauaalan 
coaponant  la  not  bandllnlcad.  Then  g[Y(t)] 
la  not  bandlialted. 
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Notice  that  Theoreaa  A and  i hold  for  any 
contaalnatlon  coaponant  N(t)  which  satlafles 
Che  alld  conditions  lapoaad  earlier.  Froa  the 
davalopaant  of  these  thaoreas  we  see  that  tha 
Cauaalan  coaponant  plays  a aajor  role  in 
causing  the  spactna  of  tha  randoa  process  to 
be  spread  by  the  nonlinearity.  Also,  It  la 
laposslble  for  the  Indapendant  concaalnatlon 
coaponant  to  "undo”  this  affect  of  the  Cauaalan 
coaponant . 
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where 


D(u)  + I b *(D(m)j' 


l{u»0)  + b 


Then  wa  sec  that  If  g(')  la  a polynoalal,  only 

a finite  nuaber  of  the  b_  are  nonsero.  In  chla 
n 

case,  we  see  that  glX(t)]  la  bandllalted  If  and 
only  If  X(t)  la  bandllalted.  In  the  case  where 
g(')  la  not  a polynoalal,  an  Infinite  nuaber  of 
tha  b|^  are  nonsero,  and  thus  g[X(t)]  cannot  be 

bandllalted.  Thus  we  saa  that  Theorea  3 holds 
without  the  assuaptlon  of  the  existence  of  a 
spectral  density  function. 


Using  the  charactarlsatlon  of  spherically 
Invariant  randoa  processaa  given  In  (6],  It 
can  ba  shown  In  a straightforward  fashion  that 
the  results  of  this  paper  hold  If  tha  tarn 
"Gaussian  process”  la  replaced  with  the  tens 
"spherically  Invariant  randoa  process." 
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oaoer  is  concerned  with  the  bandlimitedness  of  the  output  of  a nonlinearity 
a random  input.  The  input  is  taken  to  be  a contaminated 
It  is  shown  that,  i£  the  nonlinearity  is  not  a polynomial,  or  if Ga  s 
input  component  is  not  bandlimited,  then  the  output  is  not  bandlimited. 
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